
ng^^rr^ WORLD INTELLECTUAL PROPERTY ORGANIZATION 

M:\^ I International Bureau 

INTERNATIONAL APPLICATION PUBLISHED ^NDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 6 
H04L 29/06, 29/08 



Al 



(11) International Publication Number: 
(43) Internationa! Publication Date: 



WO 98/34385 

6 August 1998 (06.08.98) 



(21) International Application Number: PCT/US98/01797 

(22) International Filing Date: 30 January 1998. (30.01 .98) 



(30) Priority Data: 
60/036,661 
60/036,662 
08/818.769 



30 January 1997 (30.01.97) US 
30 January 1997 (30.01 .97) US 
14 March 1997 (14.03.97) US 



(71) Applicant: VXTREME, INC. [US/US]; 675 Almanor Avenue. 
Sunnyvale. CA 94086 (US). 

(72) Inventors: VELLANKI, Srinivas. Prasad; 400 Glenmoor 
Circle. Milpitas, CA 95035 (US). CANNON. Anthony. 
William; Apartment 334, 1600 Villa Street, Mountain View. 
CA 94041 (US). RAVI, Hemanth. Srinivas; 444 Glenmoor 
Circle, Milpitas, CA 95035 (US). KLEMETS. Anders. 
Edgar, 655 S. Fair Oaks Avenue, #K-313, Sunnyvale, CA 
94086 (US). 

(74) Agent: VIKSNINS, Ann. S.; Schwegman, Lundberg, Woessner 
& Kluth. P.O. Box 2938, Minneapolis. MN 55402 (US). 



(81) Designated States: JP. Europeari patent (AT, BE. CH. DE, DK, 
ES, Fl, FR; GB. GR. IE, IT, LU, MC, NL. PT. SE). 



Published 

With international search report. 

Before the expiration of the time limit for amending the 
claims and to be republished in the event of the receipt of 
, amendments'* 



€1.1$ 



(54) nUe: AUTOMATIC DETECTION OF PROTOCOLS IN A NETWORK 



LOOK UP HTTP 
PROXY FROM BROWSER 



-702 



START WORKER THREADS 



-704 



o 







UDP 

no. 8A 



—7 — 

790 



TCP 
RG. 8B 



—7 — 
792 



CONTROL 
RG. 9 



794 



HTTP 
PROXY 
RG. 8C 



— 7 

796 



HTTP 


80 


RG. 


80 



HTTP 
8080 
RG. 8E 



798 



788 



(57) Abstract 

am:.. c™p«=, for .u»m=,k1., d.«c«ng . mo» «lv.n»8^s pto»col ^^I.^^^'.SnttS ."^"5 

to select the most advantageous protocol from protocols associated with the subset or uie respoi :>c . 
is detcimined based on a predefined protocol priority. 



FOR THE PURPOSES OF INFORMATION QNLY 
Codes used to identify States patty to the PCT on the front pages of pamphlete publishing international applications under the PCT. 



AL 


Albania 


ES 


Spain 


AM 


Annenia 


Fl 


Finland 


AT 


Austria 


FR 


France 


AU 


Australia 


GA 


Gabon 


AZ 


Azerbaijan 


GB 


United Kingdom 


BA 


Bosnia and Herzegovina 


GE 


Georgia 


BB 


Barbados 


GH 


Ghana 


BE 


Belgium 


GN- 


Guinea 


BF 


Burkina Faso 


GR 


Greece 


BG 


Bulgaria 


HU 


Hungary 


BJ 


Benin 


IE 


Ireland 


BR 


Brazil 




Israel 


BY 


Belarus 


IS 


Iceland 


CA 


Canada 


IT 


Italy 


CF 


Central African Republic 


JP 


Japan 


CG 


Congo 


KE 


Kenya 


CH 


Switzerland 


KG 


Kyrgyzstan 


CI 


C6ie d*Ivoirc 


KP 


Democratic People's 


CM 


Cameroon 




Republic of Korea 


CN 


China 


KR 


Republic of Korea 


CU 


Cuba 


KZ 


Kazakstan 


CZ 


Czech Republic 


LC 


Saint Lucia 


DE 


Germany 


U 


Liechtenstein 


DK 


Denmark 


LK 


Sri Lanka 


EE 


Estonia 


LR 


Liberia 



LS : /Lesotho 

LT Lithuania 

. LU I-uxembouig , 

LV Latvia 

MC Monaco 

M0 Rcp(E!blflC of Moldova 

MG Madagascar 

MK The former Yugoslav 
Republic of Macedonia 

. ML Mali 

MN ' Mongolia 

MR Mauritania 

. MW Malawi 

MX Mexico 

NE NigfT 

NL Neiheriands 

NO Norway 

NZ New Zealand 

PL Poland 

FT Portugal 

RO Romania 

RU Russian Federation 

SD Sudan 

SE Sweden 

SG Singapore 



SI 


Slovenia 


SK 


Slovakia 


SN 


Senegal 


sz 


Swaziland 


TD 


Chad 


TG 


Togo 


TJ 


Tajikistan 


TM 


Turkmenistan 


TR 


Turkey 


TT 


Trmidad and Tobago 


UA 


Ukraine 


UG 


Uganda 


US 


United States of America 


uz 


Uzbekistan 


VN 


Viet Nam 


YU 


Yugoslavia 


ZW 


Zimbabwe 



wo 98/34385 



PCT/US98/01797 



AUTOMATIC DETECTION OF PROTOCOLS IN A NETWORK 

BACKGROUND O F THF TNVFTsrnON 
The present invention relates to data communication in a computer 
5 network. More particularly, the present invention relates to improved methods 
and apparatus for permitting a client computer in a client-server architecture 
computer network to automatically detect the most advantageous protocol, 
among the protocols available, for use in communicating with the server 
irrespective whether there exist firewalls or proxies in the network. 
1 0 Client-server architectures are well known to those skilled in the 

computer art. For example, in a typical computer network, one or more client 
computers may be coupled to any number of server computers. Client 
computers typically refer to terminals or personal computers through which end 
users interact with the network. Server computers typically represent nodes in 
1 5 the computer network where data, appHcation programs, and the like reside. 
Server computers may also represent nodes in the network for forwarding data, 
programs, and the like from other servers to the requesting client computers. 

To facilitate discussion,;Fig. .I Jilustrates a computer network 100, 
representing for exampie a subset of m international, ppmputer network 
20 popularly known as the Internet, i As :i5;WpU known, the ta^^ 

well-known international computer network that links, apaong^others, various 
military, governmental, ediacational, nonprofit, industrial and financial 
institutions, commercial enterprises, and individuals. There are shown in Fig. ] 
a server 102, a server 104, and a client computer 106. Server computer 104 is 
25 separated from client computer 106 by a firewall 108, which may be 

implemented in either software or hardware, and may reside on a computer 
and/or circuit between client computer 106 and server computer 104. 

Firewall 108 may be specified, as is well known to those skilled in the 
art, to prevent certain types of data and/or protocols from traversing through it. 
30 The specific data and/or protocols prohibited or permitted to traverse firewall 
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108 depend on the firewall parameters, which are typically set by a system 
administrator responsible for the maintenance and security of client computer 
106 aiidy'or other computers connected to it, e.g., other computers in a local area 
network. By way of example, firewall 108 may be set up to prevent TCP, UDP, 
5 or HTTP (Transmission Control Protocol, User Datagram Protocol, and 
Hypertext Transfer Protocol, respectively) data and/or other protocols from 
being transmitted between client computer 1 06 and server 104. The firewalls 
could be configured to allow specific TCP or UDP sessions, for example 
outgoing TCP connection to certain portsi, 'UDP: sessions to certain ports, and the 

10 like.'' ' ' ■ • ' ' ' ■ ' " . 

Without a firewall, any t>'pe of data and/or protocol may b^ 

communicated between a client computer and a server computer if appropriate 
software and^or hardv^^are are employed, -For' example, server 1 02 resides on the 
same side of firewalM 08 as' client computer 1 06, i.e., .firewall 1 08 is not 
1 5 disposed in between the conimunicatidn path between server 1 02 and client 
computer 106. Accordingly, few if any, of the protocols that client computer 
1 06 may "employ to communicate with- se^^ may be blocked. 

' • As is well known to those'skiUed in the art, some computer networks 
mdy be provided with piroxies, i.e.; software codes or hardware circuities that 
20 facilitate the indirect comihuhication between a client computer and a server 
ai-ound a firewall. With reference to Fig. I; for example, client computer 106 
rnay cbmmuiiicate with server 104 througlv proxy 120. Through proxy 120, 
HTTP data, which may otherwise be blocked by firewall 108 for the purpose of 
this example, may be transmitted betv^'een client computer 1 06 and server 
25 computer 104. 

In some computer networks, one or more protocols may be available for 
corrtmunication between the client computer and the server computer. For 
certain applications, one of these protocols, however, is often more 
advantageous, i:e., suitable, than others. By way of example, in applications 
30 involving real-time data rendering (such as rendering audio, video, and/or 

annotation data as they are streamed from a server), it is highly preferable that 
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the client computer executing that application selects a protocol that permits the 
greatest degree of control over the transniissipn of data packets anc^o^, enables 
data transmission^ to occur at the highest possible rate.. . This is beqause these 
applications are fairly demanding.' in terms of t^^^ 

5 reliability requirements. Accordingly, the quality of the data rendered, e.g., the 
video and/or audio clips played ^ often depends on \yhether the iisejr has 
successfully configured the client computer to receive data from the server 
computer using thfe most advantageous pirotocGl avail^bl% . . 

In the prior art, the selection of the most advantageous protocol for 

1 0 communication between client computer 1 06 and server computer 1 04 typically 
requires a high degree of technical . sophi^tiqation on the part,pf ttie.user of client 
computer 1 06. By way of example,' iti3:]typicaUy;ne^ in t^e prior art, for 
the user of client computer . IM toiunders^ tppolpgy of computer p^tw^ 
100, the protocols available for*use;udtih:t^ net>vprk,;md^^ 

1 5 can traverse firewall 108 before Al;^ti<^rit;3nrbe;^xp^^^^^ to^f pi^dTigure his client 

cbmptiter r06ifbr>eommankationir . ; • ;v.\;::- : : 

Thia lev^l bf tecimicad^ sbphhti^^^lijGm hpi^feiwr,; likely to be beyppd that 
typically pC^Bsessed -by m^averagfeu^ Accordingly, 
users in} the prior ^ art often find k:di£ficti^^ config^e, theu client computers. , - 
20 even for sirriple communication rtasks^vvdth the netyvork., The diffipulties may be . 
encounterejd for example diuing; the initiaf setup pr .whe^^ver iJaere/^ 
in the topology of computer netwp*H;l'90 and/or in the technology , employed to 
transmit data between client computer 1 06 and seryer 1 04. Typically, expert and 
expensive assistanceis required^,; if such assistance is available at all in the 
25 geographic area of the user. 

Fvuthermore, even if the user can configure client computer 1 06 to 
commxmicate with server 104 through firewall 108 and/or proxy 120, there is no 
assurance that the user of client computer 106 has properly selected, among the 
protocols available, the most advantageous protocol communication (e.g., in 
30 terms of data transmission rate, transmission control, and the like). As 

mentioned earlier, the ability to employ the most advantageous protocol for 
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communication, while desirable for most networking applications, is particularly 
critical in applications such as real-time data rendering (e.g., rendering of audio, 
video, and/or annotation data as they ai*e received from the server). If a less than 
bptim£d protocol is chosen for communication, the quality of the rendered data, 
5 e.g., the video clips arid/or audio clips, may suffer. 

In view of the foregoing, there are desired improved techniques for 
permitting a client computer in a client-server network to efficiently, 
automatically, and appropriately select the most advantageous protocol to 
commimicate with a server computer. V - - 

10 SUMMARY OF THE INVENTION - ^ ; 

The invention i-elates, in one embodiment, to a method in a computer 
network for automatically detecting afmost advantageous protocol for 
conmiunication by a client computer. The client computer is configured to be 
coupled to a server computer via a computer network. The method iricludes 
15 sending from the client cbmputer to the server computer, a plurality of data 

requests. ' Each of the- data requests employs a different protocol and .a different 
coimection. The data requests arexotifigure^^ to the data 

requests, a set 'of responses from the server computer. Each of the responses 
employs a protocol 'associated v/ith a: respective one of the data requests. 
20 Tlie method further includes receiving at t^^ 

sublet of the responses. TTie method also inci\ides monitoring the, subset of the 
responses as each response is received from the server computer to select the 
most advantageous protocol from protocols associated with the subset of the 
responses, wherein the most advantageous protocol is determined based on a 
25 predefined protocol priority. 

In another embodiment, the invention relates to a method in a computer 
network for automatically detecting a most advantageous protocol for 
communication by a client computer. The client computer is configured to be 
coupled to a server computer via a computer network. The method includes 
30 sending from tiie client computer to the server computer, a plurality of data 
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requests. Each of the data requests employs a different protocol and a diffe;:efit 
connection. ■- • ' -v- ^ .■: ■•■:■^v.■: -rr-. . ;.,-,s - ^ ; 

The method further includes; receiving at least a subset of the data , 
requests at the server computer: The method, additionally includes sending a set 
5 of responses form the server computer to the client computer. The. set of 

responses is responsive to the subset of the data requests; Each of the responses 
employs a protocol associated with a respective^pne of the. subset of the data 
requests. The method also includes receiving at:the client computer at le^t a 
subset of the responses. There is further included selecting, for the „ . 
10 communication between the cliehtebmputer and 

ad vantageous protdbol from proiocolsiassociated with the subset of the 
responses; wherein the most advantageous-protocol is determined based qn ? 
predefinedprotocolprrority. -n' vL- ,ii •• : . . :• ■^.■■■'v::v - v 

In y et-another embodimrent,? the. inventioii relates to a compute^^T?adable 
1 5 medium containing computer>-readahle4nstnA<?tiQ?^ fo^autpmatic^^^ 4^tP'^^J^S ^ ; 
most advbltageous protocol for comm»m 

computer is- ebtlfigured td be: ca-upledfjQia: s.^grvCGCiRUter ,yia a computer „ 
network. The eoinpiater-readable instrocttons iCQmprise, computer-readable 
instructions for sending in:a substantially ;pamllel.ma!iwier, from^;^^^ 
20 computer td the server computer, a pluraUlty ofd^ requests.,, Ea^^^^^ data 
requests employs a different protoc.Ql;and a; different conjn^^ 
requests are configured to soliciti responsiyejtq the data requests, a set of ^ 
responses from the server, computer. Each of the responses employs a protocol 
associated with a respective one of the data requests. 
25 The computer-readable medivim further Includes computer-readable 

instructions for receiving at the client computer at least a subset of the responses. 
There is farther included computer-readable instructions for. monitoring the 
subset of the responses as each response is received from the server computer to 
select the most advantageous protocol from protocols, associated with the subset 
30 of the responses, wherein the most advantageous protocol is determined based on 

o ry^t^Af^^rkt^A r»rnt nr.nl nnontv. 
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These and other features of the present ihventioB will be described in 
more detail below in the detailed descriptiori of the invention and in conjunction 
with the following figures. 

BIHEF DgSC RIPTIQN OF THE PRAWINQS 
5 To facilitate discusisioii. Fig. 1 illustrates a computer network, 

representing for example a portion of an international computer network 
popularly known as the Internet. 

Fig. 2 is a block diagram of an exemplar computer system for carrying 
out the autodetect technique according to one embodiment of the invention. 
10 Fig. '3 illustrates, in accordance with one embodiment, the control and 

data connections between a client application and a server computer when no 
firewallis provided in the networks • ^ :^ ; : : . 

Fig; 4 iiluistfates another network arrangement .wherein control and data . 
connections are established through a firewalL • 
15 Figs. 5A-B illustrate another network arrangement wherein media control 

commands and media data may^be communicated between a client computer and 
server computer lising tl^ OT ■ : - - v ^ ; ./ :,. 

Figs. 5C-D illustrate another nemwk iu^ran wherein multiple 

■ HTTP coiitrbi and data coimectiohs are inul^^^^ througha single HTTP port. 
20 Fig. 6 illustrates another network arrangement wherein control and data 

cohhectioris' iare transmitted betv/een the client application and the server 
computer via a proxy. ' ^ ^ ^'^^ ^ ' ■ ^ , . 

Fig. 7 depicts^ in accordance with one embodiment of the present 
invention, a simplified flowchart illustrating the steps of the inventive autodetect 
25 technique. 

Fig. 8 A depicts, in accordance with one aspect of the present invention, 
the steps involved in executing the UDP protocol tiiread of Fig. 7. 

Fig. 8B depicts, in accordance with one aspect of the present invention, 
the steps involved in executing the TCP protocol thread of Fig. 7. 
30 Fig. 8C depicts, in accordance with one aspect of the present invention, 

the steps involved in executing the HTTP protocol thread of Fig. 7. 
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Fig. 8D depicts, in accordance with one aspect of tihie present invention, 
the steps involved in executing the HO^P; 80 protocol thread of Fig, 7.: r 

Fig. 8E depicts, in accordance with one aspect of th?. present invention, 
the steps involved in executing liie!; H prptocol thread of Fig. 7. 

5 Fig. 9 illustrates, in accordanqe with one embodiment ot the 

invention, the steps involved in ejxecuting the control threap of Fig, 7, r 

DFTATT.KD DESCRIPTION OF THH PREFERRED EMBODIMENTS 
The present invention will nov^? be described;^^^^ to a 

few preferred embodimentsi-ths^reof ;as iUx^ated in thq, accompany ipg; drawings. 
10 In the follov^ng deseriptioiurnumeroijs specifipi d^tails^^ forth in order to 
provide a thorough understanding ofrthe pr^^eyit invention It vyrill be apparent,- 
however, to one skilled in the art, that the prospntinvention may be. practiced 
without some orall of ihese specific dejaik. .In other; instan?eSj!^yell-lpow^ 
process steps have not been describa^d in d^tajl/inpriiep;)^^ 
15 obscure^the present inventiQn.^rv;a., ih-.^vv.r:six -:«d:aru. rycijiivii; ^ / ■ ; 
- .In accordance with; oniedaspectsQ^^^ 
computer in a heterogeneous client-ser\i^>«gmpmearmetwork{^^ 
computer -1 06dn;Pig. 1 ) is prowdedrytEitbiaij j^utp mech^yiisrn.;^ When 
execiited,' the autodetect' iteecbanisaa,^dyaaitageouslyr^ cUent xpmputer 106 
20 to select, in an efficient and automatic; miumeT, ;tbe rnpsdiitdyjantageous^p 

for communication between the cJienJ GO^^p^t0r^dl jitS: server, Once^ the most 
advantageous protocol is selected, parameters pertaining to. the selected protocol 
are saved to enable the client computer, in future ^essfions^ to employ the same 
selected protocol for coniinvmicati9n, r; : . : : , 

25 In accordance with one particular advantageous embodiment, the 

inventive autodetect mechanism simultaneously employs multiple threads, 
through multiple connections, to initiate communication with the server 
computer, e.g., server 104. Each thread preferably employs a different protocol 
and requests the server computer to respond to the client computer using the 
30 protocol associated with that thread. For example, client computer 1 06 may, 
employing the autodetect mechanism, initiate five different threads, using 
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respectively the TCP, UDP, one of HTTP and HTTP proxy, HTTP through port 
(multiplex) 80, and HTTP through port (multiplex) 8080 protocols to request 
server 104 to respond; . - r . : . 

Upon receiving a request, server 104 responds with data using the same 
5 protocol as that associated with the thread on fvvhich the request arrives. If one or 
more protocols is blocked andrfails to reach server 1 04 (e.g., by a firewall), no 
response employing the blocked protocol would of course be transmitted from 
server 104 to client computer 106. Further, some of the protocols transmitted 
from server 104 to client computer 106 may be blocked as well. Accordingly, 
1 0 client computer may receive only a subset of the responses sent from server 104. 
In one embodimenU client computer 10.6. monitors 
responses. If the predefined "best^ protocol is received, that protocol is then 
selected for communication by client computer 1 06. The predefined "best" 
protocol may be definedin advance^by: the user and/or the application program. 
15 If the predefined ''best'' protocol is, howevervblockedr(as.the request is 

transmitted from the client computer: or;^:the:response is transmitted from the 
server, for example) the most advantageous protocol may simply, be selected 
from the set of protocols received back by th©; client computer. In one 
embodiment, the selection, may be made ampng -the set of protocols received 
20 back by the client computer within :a predefmed time:period afi:er th^ requests are 
sent . but- in parallel. 

The selection of the most advantageous protocol for commimication 
among the protocols received by client computer 106 may be performed in 
accordance with some predefined priority.- For example, in the real-time data 
25 rendering application, the UDP protocol may be preferred over TCP protocol, 
which may in turn be preferred over the HTTP protocol. This is because the 
UDP -protocol typically can handle a greater data transmission rate and may 
allow client computer 106 to exercise a greater degree of control over the 
transmission of data packets. 
30 HTTP data, while popular nowadays for use in transmitting web pages, 

typically involves a higher number of overhead bits, making it less efficient 
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relative to the UDP protocol for iransinittihg real-time data. . As is known, the 
HTTP protocol is typically built on top of TCP. The underlaying TCP protocol 
typically handles the transmission and retransmission requests of individual data 
packets automatically. Accordingly, the HTTP protocol tends to reduce the 
5 degree of contrbl client computer 106 has over the transmission of the data 
packets between server 104 and client computer 106. Of course other priority 
schemes may exist for differ^t applications, or even for different real -time data 
renderinjg applications^ ■ : . . : ^. 

In one ernbodimenU^as client computer 106 is installed a^^ 
1 0 communication with server 1 04 for the first time,, the autpdetect mechanism is 
invoked to allow client computer I06,to send transmission requests in parallel 
(e.g., using different protocols-over different coimections) in the manner, , 
discussed e^u^lier. After server 104 

connections/protocols and the most -adviantageous protocol has been selecteci by 
1 5 client corriputer 1 06 for commufticatitm- Cin accordance with sortie, predefined 
priority ), the pkf amfeters aSsoci^ted^with theiselected protocol are ithen saved for 
future cornxniriiicatiori. ^^"-^ • ai;^^tigsyj7;r -r/y-^ : :;.>:r^;i ■■ :■ 

Once the itiost advaita^^ti^ protoGoivis selected, the autodetect: . 
mechanism may- be disabled^ 'ar^rfuturercommimication between client computer 
20 106 and server i04 may proceed iising the^selected most advantageous protocol 
without fiirther invocation of the autodetect mechanism. :If the topology of 
computer network 1 00 changes and communication using the previously selected 
"most advantageous" protocol is no longer appropriate, the autodetect 
mechanism may be executed again to allow client computer 106 to ascertain a 
25 new "most advantageous" protocol for commimication with server ! 04. In one 
embodiment, the user of client computer 106 may, if desired, initiate the 
autodetect mechanism at any time in order to enable client computer 106 to 
update the "most advantageous" protocol for communication with server 104 
(e.g., when the user of client computer 106 has reasons to suspect that the 
30 previously selected "most advantageous" protocol is no longer the most optimal 
protocol for communication). 
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The inventive autodetect mechanism may be implemented either in 
software or hardware, e.g., via an IC chip. If implemented in software, it may be 
carried out by any nimiber of computers capable of functioning as a client 
computer in a computer network. Fig. 2 is a block diagram of an exemplar 
5 computer system 200 for carrying out the autodetect technique according to one 
embodiment of the invention. Computer system 200, or an analogous one, may 
be employed to implement either a client or a server of a computer network. The 
computer system 200 includes a digital computer 202, a display screen (or 
monitor) 204, a printer 206, a floppy disk drive 208, a hard disk drive 210, a 
10 network interface 212, and a keyboard 214. The digital computer 202 includes a 
microprocessor 216, a memory- bus 2 18, random access memory (RAM) 220, 
read only memory (ROM) 222, a peripheral bus 224, and a keyboard controller 
226. The digital computer 200 can be a personal computer (such as an Apple- 
computer, e.g., an Apple Macintosh, an IBM personal computer, or one of the 
1 5 compatibles thereof), a workstation computer (such as a Sun Microsystems or 
Hewlett-Packard workstation); or some other type of computer. - 
■ - The microprocessor 216 is Xgerierafl purpose digital processor which 
controls the operation of the computerisystem 200. Th^ can 
be a single-chip processor or can be = implemented with multiple components. 
20 Using instructions retrieved from memory, the microprocessor 216 controls the 
reception and manipulation of input data and the output and display of data on 
output devices. ■ ^ ^ 'v v. . ■ 

Tlie memory bus 218 is used by the microprocessor 216 to access the 
RAM 220 and tlie ROM 222. The RAM 220 is used by the microprocessor 216 
25 as a general storage area and as scratch-pad memory, and can also be used to 
store input data and processed data. The ROM 222 can be used to store 
instructions or prograin code followed by the microprocessor 216 as well as 
other data. 



30 devices used by the digital computer 202. In the described embodiment, these 
devices include the display screen 204, the printer device 206, the floppy disk 



The peripheral bus 224 is used to access the input, output, and storage 
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drive 208, the hard disk drive 210, and the network interface 212, which is 
employed to connect computer 200 tocthe network. The keyboard controller 226 
is used to receive input from keyboard 214 and send decoded symbols for each 
pressed key to microprocessor 216 o-ver bus 228. 
5 The display screen 204 is an output deyice that displays images of data 

provided by the microprocessor 216 via the peripheral bus 224 or provided by 
other components in the computer system 200: The printer^ device; 206 when 
operating as a printer provides an image on a sheetiof paper or a similar surface. 
Other output devices such as a plotter, typesetter, :etc- can be used in place of, or 
10 inadditiori to, the printer xlevice 206.; : ^ : ; - ^ v 

The floppy disk drive 20B and the hard disk drive 210 can be used to . 
store various types of data. The flbppytdisk;drive:208 facilitates transporting 
such data to other computer systems;! and hard disk drive 21 0 permits, fast ^cess ^ 
to large aniounts of stored datau. 'J ::^ : \' i - ^'/r- , ^ ; ; :v r ^ r 
15 The mibf oprbcessor '2 1 6 togejher jwith jan^dperating <sysjem operate to . 

execute computfef code and prgduceanduse data.;. ^ 
may reside on the RAM 220,: the R€ift&g22i: thei hard: disk-4rive 220^ or even on 
another computer on the netWbrkijyThe'^^om^ - - 

on a reinovable program mediumiarid: teaded'Or:install§d onto the, cqmputer 
20 system 200 when needed. : Removable progi^mi medium 

CD-ROM, PG^CARDvfloppy:disfc andanagnetic tape. - : r o . 

The network interface circuit 2 1 2 is used to send and receive data over a 
netwdrk connected to other computer systems. An interface card or similar 
device and appropriate- software implemented by the microprocessor 216 can be 
25 used to connect the computer system 200 to an existing network and transfer 
data according to standard protocols^ 

The keyboard 214 is used by a user to input commands and. other 
instructions to the computer system 200. Other types of user input devices can 
also be used in conjunction with the present invention. For example, pointing 
30 devices such as a computer mouse, a track ball a stylus, or a tablet can be used 
to manipulate a pointer on a screen of a general-purpose computer. 
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The iriveritidn can also be embodied as computer-readable code on a 
computer-readabie medium. The computeir-readable medium is any data storage 
device that can store data which can thereafter be read by a computer system. 
Examples of the computer-readable medium include read-only memory, randorn- 
5 access memory, CD-ROMs, magnetic tape, optical data storage devices. The 
computer-readable code can also be distributed over a network coupled computer 
system so that the computer-readable code is stored and executed in a distributed 
fashion. 

Figs. 3-6 below illustrate, to facilitate discussion, sonie possible 
1 0 arrangements for the transmission and receipt of data in a computer network. 
The arrangements differ depending on which protocol is employed and the 
configuration of the network itself. Fig. 3 illustrates, in accordaiice with one 
embodiment the control and data connectioiis between a client application 300 
and server 302 when no' firewall is provided in the network. 
15 Client application 300 may represent, for example, the executable codes 

for executing a real-time data rendering program such as the Web Theater Client 
2.0, available'from VXtreme, the! of Sunnyvale, California. In the example of 
Fig. 3, client application 300 includes tfie ihveritive autodetect mechanism and 
may represent a plug-in software iriodule that inay be installed onto a browser 
20 306. Browser 306 may represent, for'example, the application program which 
the user of the client computer employs to'havigate the network. By way of 
example, browser 306 may represent one of the popular Internet browser 
programs, such as Netscape™ by Netscape Commimications Inc. of Moimtain 
View, Califomia or Microsoft Explorer by Microsoft Corporation of Redmond, 
25 Washington. 

When the autodetecf mechanism of client application 300 is executed in 
browser 306 (e.g., during the set up of client application 300), client application 
300 sends a control request over control connection 308 to server 302. Although 
multiple control requests are typically sent in parallel over multiple control 
30 connections using different protocols as discussed earlier, only one control 
request is depicted in Fig. 3 to facilitate ease of illustration. 
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The protocol employed to send the control request over control . 
connection 308 may represent, for example, TCP, or HTTP. If UDP protocol is 
requested from, the server, thexeguest fronijthe^ d be sent via the control 

connection using, for example the TCP prqtocoL Initially, each control request 
5 from client application 30Q may include, for esxample, the server name that 
identifies server 302, the port through yvhich control connection may be 
established, and the name of the video SEtream requested by client application 
300. Server 302 then responds with data via data cormection 310. . , 

In Fig. 3, it is assunieci that.jip proxies and/or firevsralls e^cist. 
1 0 Accordingly, server .302 responds u^Wg the saine protocol as that employed in 
the request. If the request employsTQP, hovvever, server 302 may attempt to 
respond using either UDP or TjC? data connections (dependirig on the specifics 
of the request). The resppnse is se|it to, client application via data connection 
310, If the protocol received by thp client application is subsequently selected to 
1 5 be the "most adyantageous" prptocpL subse^ .communication between client 
..application apO and server 
data connection 3 lO. - Sub^eq^^ client application 300 

via cpntrplcomiectiqn 3^^ for example, stop, play, fast forward, ^ 

rewind, pause, unpause, and j^e liHp. . Tfeese co^^ requests may be utilized by 
20 server 30?. to control the deliyery pf iJae data stream from server 302 to client 
application 300 via data coryiectipn 310^ 

; It should be noted that altho.ugh only one control connection and one data 
connection is shovm in Fig. 3^ to simplify illustration, multiple control and data 
connections utilizing the same protpcol may exist during a data rendering 
25 session. Multiple control and data connections may be required to handle the 
multiple data streams (e.g., audio, video, annotation) that may be needed in a 
particular data rendering session. If desired, multiple client applications 300 
maybe installed within browser 306, e.g., to simultaneously render multiple 
video clips, each with its own sound and annotations. 
30 Fig, 4 illustrates another network arrangement wherein control and data 

connections are established tfirough a firewall. As mentioned earlier, a firewall 
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may have policies that restrict or prohibit the traversal of certain types of data 
and/or protocols; In Fig. 4, a firewall 400 is disposed between client application 
300 and server 402, Upon execution, client application 300 sends control 
request using a given protocol via firewall 400 to server 402. Server 402 then 
5 responds with data via data connection 4 1 0, again via firewall 400. 

If the data and'or protocol can be received by the client computer through 
firewall 400, client application 300 may then receive data from server 402 
(through data comiection 408) in the same protocol used in the request. As 
before, if the request employs the TCP protocol,, the server may respond with 
1 0 data connections for either TCP or UDP protocol (depending on the specifics of 
the request). Protocols that may traverse a firewall may include one or more of 
the following: UDP, TCP, and HTTP. 

In accordance with one aspect of the present invention, the HTTP 
protocol may bie employed to send/receive~media data (video, audio, annotation, 
1 5 or the like) between the client and the server. Fig. 5A.is a prior art drawing 
illustrating how a client browser may coirimunicate with a web server using a 
port designatedfor conimunica:tion. 'in Fig^^ there is shovm a. web server 550, 
representing the softv/afe module for serving web pages to a browser application 
552. Web server 550 may be any of the commercially available web servers that 
20 are available from, for example, Netscape Cormhunications Inc. of Mountain 
View, California or Microsoft Corporation of Redmond, Washington. Browser 
applicaitiori 552 represents for example the Netscape browser from the 
aforementioned Netscape Communications, Inc., or similarly suitable browser 
applications. c . 

25 Through browser application 552, the user may, for example, obtain web 

pages pertaining to a particular entity by sending an HTTP request (e.g., GET) 
containing the URL (uniform resource locator) that identifies the web page file. 
The request sent via control connection 553 may arrive at web server 550 
through the HTIT port 554. HTTP port 554 may represent any port through 
30 which HTTP commimication is enabled. HTTP port 554 may also represent the 
default port for communicating web pages with client browsers. The HTTP 
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default port may represent, for exainple, either, port 80 or port 8080 on web 
server 550; As is known, one or both of these ports on web server 550 may be 
available for web page communication even if therjs are firewalls disposed 
between the web server 550 and client browser application 552, which otherwise 
5 block all HTTP traffic in other ports. Using the furnished URL, web server 550 
may then obtain the desired web page(s) for sending to client .browser 
application 552 via data connection 556. : , 

The invention, in one embodiment, involves eniploying the HTTP 
protocol to cbmmtmicate media commands .from a browser application or 
1 0 browser plug-in to the server. Media commands are, for :exampie, PL A Y» STOP, 
REWIND, FAST FORWARD, and PAUSE; The.server computer may , . , 
represent, for example, a web server. The server; computer may also representa 
video server for streaming video to the client; conriputer..^^^^ use of the 

HTTP protocol the clienti computermay: successfully sendrmedia control ^pquests 
1 5 and receive media data through any:;HTTP:port.; If; the, default,HTrP port,. e,g., . 
port 80 or 8080, is specified^lhe clieiHOTayiiSy^essj^^ 

requests and receive mediaidata efven^ if #erjer €f^ist§: a. firewall pr m HTTP Proxy 
disposed in between the server eo|aputer aijd-ihe client computer^,^ ^W^h, . 
^ otherwise blocks all other traffm^thatdoe^^^ the. HTTP protppoK For 

20 example, these firewalls or: HTTP^ Proxies, do, not^^^^^ 

■■packets to'go^hrough..- . r-olrcv^vu-.-. r: • ^^n. r r ^-rrji'::;: 

As is well known to those skilled; :th^ HTTP protp9ol, as. specified by for 
example the Internet Request For Gomments RFC 1945:(T..Berners-Lee.et al.), 
typically defines only three types of requests to be sent firom the client computer 
25 to the server, namely GET, POST, and HEAD. The POST command, for 
instance, is specified in RFC 1945 to be composed of a Request-Line, one or 
more Headers and Entity-Body. To send media commands like PLAY, ^ 
REWIND, etc., the invention in one embodiment sends the media command as 
part of the Entity-Body of the HTTP POST command, The media command can 
30 be in any format or protocol, and can be, for instance, in the same format as that 
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employed when firewalls are not a concern and plain TCP protocol can be used. 
This format can be, for example, RTSP (Real Time Streaming Protocol). 

When a server gets an HTTP request, it answers the client with an HTTP 
Response, Responses are typically composed of a Status-Line, one or more 
5 headers, and an Entity-Body. In one embodiment of this invention, the response 
to the media conmiahds is sent as the Entity-Body of the response to the original 
HTTP request that carried the media command. 

Fig. 5B illustrates this use of HTTP for sending arbitrary media 
commands. In Fig. 5B, the plug-in application 560 within client browser 
1 0 application 5 62 may attempt to receive media data (e.g., video, audio, 

annotation, or the like) by first sending an HTTP request to server 564 via 
control connection 565, 'For example, a REWIND command could be sent from 
the client' 560 to the server 564 as anTTTTP packet 570 of the form: 
"POST/HTfP/ 1 .0<Entity-Body containing- rewind command in any suitable 
1 5 media protocoi>". The server can answfer to this request with an HTTP response 
572 of the form: ''HTTP/l:a2006k<Entity-Bedy containing rewind, response in 
any suitable media protoc61>";'^ - ^ :n = - ;r ^ 

The HTTP protocol can be also \iSed to send media data across firewalls. 
The client can send a GET request to the video ser\'er, and the video server can 
20 theri send the video data as the Entity-Body of tlie HTTP response to this GET 

request: ' ■ ■ ' ' - - •. - ■ - ^ ■ 

Some firewedls may be restrictive with res^^ 
permit HTTP packets to traverse only bh a certain port, e.g., port 80 and/or port 
8080. Fig. 5C illustrates one such situation. In this case, the control and data 

25 communications for the various data stream, e.g,, audio, video, and/or axuiotation 
associated with different rendering sessions (and different clients) may be 
multiplexed using conventional multiplexer code and/or circuit 506 at client 
application 300 prior to being sent via port 502 (which may represent, for 
example, HTTP port 80 or HTTP port 8080). The inventive combined use of the 

30 HTTP protocol and of the multiplexer for transmitting media control and data is 
referred to as the HTTP multiplex protocol, and can be used to send this data 
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across firewalls that only allow HTTP traffic on specific ports, e.g.,. port 80 o^ 
8080. ^ . -'-^ 1-,):^ l-, ^^rr; - :.-^::r.^ r 

;> At server 402, representing, for exaniple, server i()4;p^ 1,_ . 
conventional demultiplexer„code and/pr ,^^^^ 508 may be empipyed to decode 
5 the received data packets to ideii^i^ .wluQh stream the cpntirol request is 

associated with. : Likewise, data sent iironi seryer 402 to clieE^t application 3 PO 
may be multiplexed in advance a^server 402 iiising^ fo^ 

multiplexer code and/or circuit ^5 10.: ^Hiemultiple^^^ddata.^ port 
502. At client applicatipn 300i::the;5^^ n?ay be decoded via , „ 

1 0 conventional demuitiplexer code and/pr circuit 512 to ideutify. which stream the 
received^ data packets; is asspcial:e*wilto^?4i9i^^ annotation). , - , . 

Multiplexing and 4em\iiiti^^^^^ atthe^ cli^nt and/pr server.may be . ^ 
facilitated for::exampie by ?h^:jyise pf the R^quest-URL^ part of thp Request-Line 
of HTTP requests-bAs^merMipHe^ ab^ strticture pf requests js^ ^ 

15 described.iri-REG^1^945:.paSi§J?««^ 

stream associated wiik the dat^^d/^tcgnty^^ ^ 
embodiment, the additional information in the Reque^IJl^ ifl jhe H 
may be as smali as,one pr cliem. 
applicatioit'300 to^server402>^^ o^br^ ^^rir >vj r T'dO r bn ;- r '; ;; ; . :; 
20 ,::To furtheriacilitate:4i(Sc>ii^sip HTTl^ mukiplp^ 

technique, reference may now be made to Fig. 5D. In Fig. 5D, the plug-^p . ^ ^ 
application 660/\SvithiE client plugriji application. 660 ^P receive 
media data (e.g., video, audiov annptatipn^ or the like) by first. sending a,cpntrpl 
request 670 to server 664 viacpntrol cpiuiection 665., request is an 

25 HTTP request, which arrives at the HTTP dqfault port 654 on serye^^^ 

mentioned earlier, the default HTTP port may be either port ,80 or port 8080 in 
one embodiment. : > 

In one example, the control request 670 from client plug-in 660 takes the 
form of a command to '^POST/12469 HTTP/1 .0<Entity-Body>" which indicates 
30 to the server (through the designation 12469 as the Request-URL) that this is a 
control connection. The Entity-Body contains, as described above, binary data 
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that informs the: video server that the eiient plug-in 660 wants to display a certain 
video ;or audio clip. Softv^'are codes within server 664 may be employed to 
assign a unique ID to this peirticular request from this particular client. 

For discussion sake^ assume that server 664 associates unique ID 35, 1 22 
5 v^th a video data connection between itself and client plug-in application 660, 
and unique ID 29;999 v^th an audio data connection between itself and client 
plug-in application. The unique ID is then communicated as message 672 from 
server 664 to client plug-in application 660, again through the aforemeintioned 
HTTP default port using data connection 667. The Entity -Body of message 672 
1 0 contains, among other things and as depicted in detail 673, ;the audio and/or 
video session ID^ Note that the unique ID is imique to each data connection 
(e.g., each of the audio, video, and annotation connections) of each client plug-in 
application (since there may be multiple;client plug-in applications attempting to 
communicate through the same port> f: ..v;mv„ r : ^ 

15 Once the: connection is established,' .the ;same unique ID n 

employed by the client to issue HTTEjControl requests to server 664.. By way of 
example, client piugrin application 660 may issue a command "GET/35,122 
HTTP/LO" or 'TGST/35,122 HTTP/1;0<E data 
with the REWIND media cdnMnand>" tO ;request a video file or to rewind on the 
20 video file. Although the rev^ind command is used in Figs. 5A-:5p to facilitate 
ease of discussion, other media commands, e.g., fast forward, pause, real-time 
play, live-play, orthe like^ may of course be sent in the, Entity-Body. Note that 
the unique ID is employed in place of or in addition to the Request-URL to 
qualify the Request-URL, 
25 Once the conimand is received by, server 664, the unique ID number 

(e.g.v 35,122) may be employed by the server to demultiplex the command to 
associate the command with a particular client and data file. This unique ID 
number can also attach to the HTTP header of HTTP responses set from server 
664 to client plug-in application 660, through the same HTTP default port 654 
30 on server 664, to permit client plug-in application 660 to ascertain whether an 
HTTP data packet is associated with a given data stream. 
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Advantageously; the invention pennits med^ 
media data to be conununieated between the client computer and the server : 
computer via the default HTTP port, e.g., port 80 or 8080 in one embodiment, 
even if HTTP packets are otherwise blocked by^ a firewall disposed between the 

5 client computer and the server computer. The association of each control 

connection and data connection to each client with a tmique ID advantageously 
permits multiple control an data connections (from one or more clients) to be 
established through the same default HTTP port on the server, advantageously 
bypassing the firewall. Since both the server and the client have the 

1 0 demultiplexer code and/or circuit that resolve a particular unique ID into a : 
particular data stream, multiplexed data conimunication is advantageo^^^^ 
facilitated thereby;- '■■.■yo:} n^.^^-^^^r:'\--,. :.; ■ -..i.^;:- j • ^ - 

In some networks; it -may not be possible to traverse the firewall due to, 
stringent firewall policies. As mentioned earlier, .Tt may; be ipossibledn these ■ 

1 5 situations to' allow the client: appUdation to communicate: with a server using a 
proxy. Fig. 6 illustrates this $iWati^Ji whCTe^^^^ 

proxy 602 to communicate witil seiwr402. -The i^eof proxy <602. may be:: 
necessary since client Application 3<30 iiAa^^ is strictly ... 

prohibited by firewall 604, Ther identity bf^proxy• 602 may be fdimd in browser 
20 program 306, e^g:, Netscape as-it employs the proxy .to doAvnload its web pages, 
or may be configured by the user hiniselfr fTypical protoeolS:that may .emplpy a 
proxy for communication, e.g., proxy: 602, includes HTTP. and UDP. 

In accordance with one embodiment of the present invention, the 
multiple protocols that may be employed for communication between a server 
25 computer and a client computer are tried in parallel during autodetect. In other 
words, the connections depicted in Figs. 3, 4, 5C and 6 may beiattempted 
simultaneously and in parallel over different control connections by the client 
computer. Via these control connections, the server is requested to respond with 
various protocols. 

30 If the predefined "best" protocol (predetermined in accordance with some 

predefined protocol priority) is received by the client application firom the server, 
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autodetect may, in one embodiment, end immediately and the "best" protocol is 
selected for immediate communication. In one real-time data rendering 
application, UDP is considered the "best" protocol, and the receipt of UDP data 
by the client may trigger the termination of the autodetect 
5 If the "best" protocol has not been received after a predefined time 

period, tlie most advantageous protocol (in terms of for exaniple data transfer 
rate and/or transmission control) is selected among the set of protocols received 
by the client. The selected protocol may then be employed for commimication 
between the client and the server. - : 

10 Fig. 7 depicts, in accordance with brie embodiment of the present 

invention, a simplified flowchart illustrating the steps of the inventive autodetect 
technique. In Fig: 7; the client application starts (in step 702) by looking up the 
HTTP-proxy, if there is anyy ftom the browser.^ As stated earlier, the client 
computer may have received a web page from the browser, >yhich implies that 
1 5 the HTTP protocol may have been employed by. the browser program for . 
communication. If an HTTP proxy is required, the name and location of the 
HTFP proxy is likely known to theubrowser,-; and this knQwledge may . be 
subsequently employed by the client to at ieast enable communication with the 
server using the HTTP proxy protocolvi.e.v if a. more advantageous protocol 
20 cannot be ascertained after autodetect. . J ■ : , 

' In step 704, the client begins the autodetect sequence by starting in 
parallel the control thread 794, along with five protocol threads 790, 792, 796, 
798, and 788. As the term is used herein, jparallel refers to both the situation 
wherein the multiple protocol threads are sent parallely starting at substantially 
25 the same time (having substantially similar starting time), and the situation 

wherein the multiple protocol threads simultaneously execute (executing at the 
same time), irrespective when each protocol thread is initiated. In the latter case, 
the multiple threads may have, for example, staggered start time and the 
initiation of one thread may not depend on the termination of another thread. 
30 Control thread 794 represents the thread for selecting the most 

advantageous protocol for communication. The other protocol threads 790, 792, 
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796, 798, and^ 788 represent threads for initiating in pardlel. commynication \ s 
using tlie various protocols, e.g., UDP, .TGP,;HTTP proxy, HTTP through port 
80 (HTTP 80), and HTTP through port 8080 (HTTP 8080); Although only five 
protocol threads are shown, any nuniber of protocol threads may be initiated by 
5 the client, using any conventional and/or suitable protocols. The steps associated 
with each of threads 794v 790, 792, 796, 798; and 788 are discussed herein in 
connection with Figs.^ 8A-8E and 9. ; . : :u a ^ ^ 

- In Fig. 8 A, the UDP protocol thread is executed,^ The client^ inquires in 
step 716 whether a UDP proxy is required. If the UDP proxy , is. required^ the 
10 user may obtain the name of the UDP proxy from, for example, the system 
administrator in ordeJr to use the UDP proxy to facilitate commimication to the 
proxy (in step 718). ^ If ;n6 UDP ^ptoxy i^ required, the client may directly connect 
to the server (in step 720). Thereafter, the client may begin sending a data \ - 
request (i;e., a control request) to^the :se:rver;in^^^ 
15 (either thtough the proxy if a proxyis/involw^ if no 

proxyusreqtiired).--."^'--- ^^x--^:-^ -TZ'i; -.r. :■ - .rr\-^;-. . 

In Fig. 8B, the TGP;pfotoccA^lH:eadii:exficuted IflTCP protpcpl is ; , 
employed^ the client typibally directly connects to jthe server (in step 726), - 
Thereafter, the client may begin sending K data request (i.S^, a epntrpl request) to 
20 the server using the TCP protocol (step 724);: ri • . ; ;n . 

In Fig. 8G, the HTTP protocol tiireadis executed:: The client inquires in 
step 716 whether an HTTP proxy is. required. If the HTTP proxy i? required, the 
user may obtain the name of the HTTP, proxy from, for example, the browser 
since, as discussed earher, the data pertaining to the proxy may be kept by the 
25 browser. Alternatively, the user may obtain data pertaining to the HTTP proxy 
from the system administrator in order to use the HTTP proxy to facilitate 
communication to the server (in step 732). 

If no HTTP proxy is required, the client may directly connect to the 
server (in step 730). Thereafter, the client may begin sending a data request (i.e., 
30 a control request) to the server in step 734 using the HTTP protocol (either 
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through the proxy if a proxy is involved or directly to the server if no proxy is 
required): - . , : . 

In Fig. 8D, the HTPP 80 protocol thread is executed. If HTTP 80 
protocol is employed, HTTP data may be exchanged but only through port 80, 
5 which may be for example the port on the client computer through which 
communication with the network is peraiitted. Through port 80, the client 
typically directly connects to the server (in step 736). Thereafter, the client may 
begin sending a data request (i.e., a control request) to the server (step 738) using 
the HTTP 80 protocol: ' - 
10 In Fig, 8E, the HTTP 8080 protocor thread is executed. If HTTP 8080 

protocol is employed, HTTP data mtay be exchanged but only through port 8080, 
which may be the port on the client coniputer for communicating with the . 
network. Through port 8080, the client typically directly connects to the server 
(in step 740). Tnereafter; the client liiay begin sending a data request (i.e., a 
1 5 control request) to the ^fefver (step 742)Hiising> the HTTP 8080 protocol. The 
multiplexing and deniultiplexihg tedtiiiques tiiat may be employed for 
corhmuriication through port 8D, have been, 

disciissed earlier and arie hot repe^ 

Fig. 9 illustrateis^ in accofdmce w^^ of the present ^ 

20 invention, control thread 794 of Fig. 7. It should be emphasized that Fig. 7 is but 
one way of implementing the cohtrbl threaid; other techniques of implementing 
the control thread to facilitate autodetect should be apparent to those skilled in 
the art in view of this disclosure. In step 746, tlie tiiread determines whether the 
predefined timeout period has expired. The predefined timeout period may be 
25 any predefined dxiration (such as 7 seconds for example) from the time the data 
request is sent but to the server (e.g., step 722 of Fig. 8A). In one embodiment, 
each protocol thread has its own timeout period whose expiration occurs at the 
expiration of a predefined duration after the data request using that protocol has 
been sent out. When all the timeout periods associated with all the protocols 
30 have been accounted for, the timeout period for the autodetect technique is 
deemed expired. 
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- If the timeout has occurred, the ;thread moves to step 754 wherein the , 
most advantageous protocol among the set of protocols received back from the, 
server is selected for communication. As mentioned, ^the selection of the most 
advantageous protocol may be performed in accordance with some predefined 
5 priority scheme, and data regarding the selected, protocol may be saved, for future 
communication sessions between this* seiryer and this client. , 

If no timeout has occurred, the thread proceeds Xo step 748 to wait for 
either data from the server or the expiratipn of the timeout period. If timeout 
occurs, the thread moves to step 754, which has been discussed earlier. If data is 
1 0 received from the server, the thread nripves to, step 750 to ascertain whether the 
protocol associated with the data received from the server is the predefined 
"best'^protocol, e.g., in accordance wit^^ ^ . . u.. 

If the predefined "best" protocol (e.g., UDP in some real-time data „ . 
rendering applications) is received, the thread preferably m^^ to step 754 to , 
1 5 terminate the autodetect and; to iiT>mediately begin using this protpcol. for data 
communidation instead of waiting for ;theti^ . 
the duration of the autodetect sequencp vmay be sub 

predefined timeout peiiod; In this manner, rapid autodestect of th^ ino?t suitable, 
protocol and rapid establishment of ;cpmramiiGati^ 

20 facilitated.- • l:-:- , -u-^r - ^ \ - ■ . , 

If the predefined "best" protocol is nptTeceiyed in st^p 75 0. the. thread 
proceeds to step 752 to add the receiyedprotocol to the received set. This 
received protocol set represents tiie set of protocols from which the "mpst 
advantageous" (relatively spealdng) protocol is. selected. The mpst a.dv^tageous 

25 protocol is ascertained relative.to otl^er protocols in the received.protocpl set 
irrespective whether it is the predefined "best" protocol in accordance with the 
predefined priority. As an example of a predefined protocol priority, IJDP may 
be deemed to be best (i.e., the predefined best), followed by TCP, HTTP, then 
HTTP 80 and HTTP 8080 (the last two may be equal in priority). As mentioned 

30 earlier, the most advantageous protocol is selected from the received protocol set 
preferably upon the expiration of the predefined timeout period. 
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From step- 752, the thread returns to step, 746 to test whether the timeout 
period has expired. If not, the thread continues along the steps discussed earlier. 

Note that since the invention attempts to establish conununication 
between the client application and the server computer in parallel, the time lag 
5 between the time the autodetect mechanism begins to execute , and the time when 
the most advantageous protocol is determined is minimal. If conmiunication 
attempts have been tried in serial, for example, the user would suffer the delay 
associated with each protocol thread in series, thereby disadvantageously 
lengthening the time period between communication attempt and successful . 
10 establishment of commxmication; ^ j 

The saving in timie is -even more dramatic in the , event the netvvork is 
congested or damaged. In some networks, it may, take anywhere from 30 to 90 
seconds before the client application realizes:that an attempt to connect to the 
server (e.g., step 720, 726, 730, 736, or 740) has failed. If each protocol is tried 
1 5 in series, as is done in one embodiment, the delay may, in some cases, reach 

minutes before the user realizes that the network is imiisable and attempts should 
be made at a later time. 

By attempting to establish communication via the multiple protocols in 
parallel, network-related delays are suffered in parallel. Accordingly, the user 
20 does not have to wait for muhipie attempts and failures before being able to 

ascertain that the network is imusable and an attempt to establish communication 
should be made at a later time. In one embodiment, once the user realizes that 
all parallel attempts to connect with the network and/or the proxies have failed, 
there is no need to make the user wait tmtil the expiration of the timeout periods 
25 of each thread. In accordance with this embodiment, the user is advised to try 
again as soon as it is realized that parallel attempts to connect with the server 
have all failed. In this manner, less of the user's time is needed to establish 
optimal commimication with a network. 

While this invention has been described in terms of several preferred 
30 embodiments, there are alterations, permutations, and equivalents which fall 

within the scope of this invention. For example, although the invention has been 
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described with reference to sending out protocol threads in parallel, the , , 
automatic protocol detection. technique also applies when the protocol threads 
are sent serially . In this ease, while it may take longer to select the most; 
advantageous protocol for selection, the automatic protocol detection technique 
5 accomplishes the task without requiring any sophisticated technical knowledge 
on the part of the user of the client computer. The duration of tlie autodetect 
technique, even when serial autodetect is employed, may be shortened .by trying 
the protocols in order of th^ir desirability and ignoring less desirable protocols 
once a more desirable protocol is^obtained: Ifcshould also be noted that there are 
10 many alternative ways of implementing the methods and apparatuses of the 

present invention. It is therefore intended that the following appended claims be 
interpreted a^ including all such alterations; permutations^ and; equivalents as, fall 
vvithin the true spirit arid scope of the present invention. 
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What is claimed is; 

1 . In a computer network, a metliod for automatically detecting a 
mo^t advantageous protocol for communication by a client computer, said client 

5 computer being configured to be coupled to a server computer via a computer 
network, comprising: 

sending, from said client computer to said server computer, a plurality of 
data requests, each of said data requests employing a different protocol and a 
different cormection,' said data requests bfeing configured to solicit, responsive to 
1 0 said data requests, a set of responses frorb said server computer, each of said 
responses employing a protocol associated with a respective one of said data 
requests;' ' *' - - ■ • • 

receiving at said client computer at least a subset 6f said responses; and 
monitoring said subset of said responses as each response is received 
1 5 from said server computer to keiect said rhost -advantageous protocol from 
protocols associatied with'ssud siibset of imU^^^ 

advantageous protocol is determined based on a predefined protocol priority. 

2, "llie me^od of claim I whereiri sa'id sending is performed in a 
20 substantially parallel manner. 



3. The metfidd of claim 2 wherein said plurality of data requests are 
sent siibstantiaJly at the same time. 

25 4. The method of claim 2 wherein said plurality of data requests 

execute concurrently. 

5. The method of claim 2 wherein said most advantageous protocol 
represents a predefined best protocol, said client computer, upon receiving a 
30 response employing said predefined best protocol, immediately designates said 
predefined best protocol said most advantageous protocol. 
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6. The method of claim 3 wherein said control thread selects said ^ . 
most advantageous protocol upon an expiration of a timeout period if said 
predefined best protocol is not received at said ,client conaputer upon said 
expiration, said timeout period being ipeasuresd from a transmitting time of said 

5 one of said data requests, said subset jof responses representiiig respor^ses 
received from said server computer during said timeout periqd. 

7. . The method of claiin.4.wh^^^ 

computer executing :an,appli9^tio^ forrenderiing real-time dat^ a3 said real-time . 
10 data isrreeeived from said server potr^^ . ^ , ^ , . , 

8. The method of claim 7 wherein said computer network represents 
the Internet. and'Said predefined-^ VP^v 

15 - 9; .The,meAQd;pf c.l^^ f^^V^WP .dataj:epre?ents one 

of a video data streaio, an au^ 

. - '. :., :-:.-.;or>K|- D^nb'^b\riq a no b*?c;i:d'Lr>ni'r^'--'^o u k'or/ovq ^ v - -iV^^w;;.,:.-;; - 
10. In a computer network, a method for automatically detecting a 

most-advantagepus^protopoL fo^. cony:|)}^icati.9 by ?i plij^i^t computer, said client 
20 computer being configured to be coupled to a servei; qp^npyter via a computer 
network, comprising: 

: - ; sending, from smd clie^it 9^ server cpmputer, a plurality of 

data requests, each of said data requests employing a differept protpcol ^d a 
different connection; 

25 . receiving, at least a subset of said data requests, at s^d server computer; 

sending a set of responses from said server computer to said client 
computer, said set of responses being responsive to said subset of said data 
requests, each of said responses employing a protocol associated with a 
respective one of said subset of said data requests; 

30 receiving at said client computer at least a subset of said responses; and 
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selecting, for said contmiinitStion between said client computer and said 
server computer, s£iid most advantageous protocol from protocols associated 
with said subset of said responses, wherein said most advantageous protocol is 
determined based on a predefined protocol priority. 

11. The method of clairn 1 0 wherein said sending is performed in a 
substantially parallel maimer. 

12. Themethoddf claim Id wherbiri said ihos^^^ 

10 represents a predefined best protocol, said selecting comprises: 

monitoring, employing said clifent computer, said subset of said responses 
as each one of said subset of said responses is received at saidxlient computer 
from said server computer for a response employing said predefined best 
protocol; and 

1 5 designating said predefined best protocol said most advantageous 

protocol, thereby imiriediatery perttiittihg s^d client comp^^ employ said 
predefined best protocol for coiiimMcatibW'^ server computer without 

further receiving additional responses fi-om said server computer. 

20 13. ' The method of blaim 10 Mete^^^^^ 

selecting at ah expiration of k timeout period said most advantageous 
protocol from said protocols associated with said subset of responses, said subset 
of responses representing responses received from said server computer during 
said timeout period. 

25 

14. The method of claim 13 wherein said timeout period represents a 
predefined time period associated with one of said data requests measured form a 
transmitting time of said one of said data requests. 
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15. The meithod of claim 1.4 wherein said client computer represents a 
computer executing an application for-rendering real-time data as said real-time 
data is received from said server .computer. . . 

5 16. The method of claim 1 5 wherein said computer network 

represents the Internet and said predefined best protocol represents UDP. 

1 7 . The method of claim 1 5 wherein said real-time data represents 
one of a video data stream,,an audio, data stream, and an ,^otation data stream. 

10 . v-s. t :..-; . . ■ ■. ., ' . , . 

; 18. Themethodof claim 1,7. >yherein said da^^ 
least one of a UDP, . TCP, HTTP proxy , HTTT,80^ and HTTP 8080 protocols. 

1 9. The method of claim 1 8 wherein said HTTP 80 protocol 
1 5 represents a protocol for permitting njijltipfe HT^ dato streani^ to be 

transuiitted in a mul$iplexedman^^ HTTP data 

streams, representing said yid?9;<^a^.?M^.f^^ 

20. The method of claim 19 wherein said HTTP 8080 protocol 
20 represents a protocol for pemitting mPltipl.? HTTP data streams to be 

transmitted in a multiplexed manner. through port ?0^0, s^d multiple HTTP data 
streams representing said video data, sttpam and sm^^ 

21. A computer-readable mediimi containing computer-readable 
25 instructions for automatically detecting a most advantageous protocol for 

communication by a client computer, said client cpmputer being configured for 
coupling to a server computer via a computer network, said computer-readable 
instructions comprise: 

computer-readable instructions for sending in a substantially parallel 
30 manner, from said client computer to said server computer, a plurality of data 

requests, each of said data requests employing a different protocol and a different 
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connection, said data requests being configiired to solicit, responsive to said data 
requests, a set of responses from said server computer, each of said responses 
employing a protocol associated with a respective one of said data requests; 

computer-readable instructions for receiving at said client computer at 
5 least a subset of said responses; and 

computer-readable instructions for monitoring said subset of said 
responses as each response is received from said server computer to select said 
most advantageous protocol from protocols associated with said subset of said 
responses, wherein said most advantageous protocol is determined based on a 
10 predefined protocol priority. 

22. The computer-readable medium of claim 21 wherein said most 
advantageous protocol represents a predefined best protocol, said client 
computer, upon receiving a response employing said predefined best protocol, 

1 5 immediately designates said predefined best protocol said most advantageous 
protocol. 

23. The computer-readable medium of claim 22 wherein said control 
thread selects said most advantageous protocol upon an expiration of a timeout 

20 period if said predefined best protocol is not received at said client computer 
upon said expiration, said timeout period being measiired from a transmitting 
time of said one of said data requests, said subset of responses representing 
responses received from said server computer during said timeout period. 

25 24. The computer-readable medium of claim 23 wherein said client 

computer represents a computer executing an application for rendering real-time 
data as said real-time data is received from said server computer. 

25. The computer-readable medivun of claim 24 wherein said 
30 computer network represents the Internet and said predefined best protocol 
represents UDP. 
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26. The computer-r 
time data represents one of a video data stream, an audio data stre an . 

annotation data stream. " ' - ^ : ? . : r r. 
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